A Qualitative Assessment of Measures for the Evaluation of a Cover Song Identification System
نویسنده
چکیده
The evaluation of effectiveness in Information Retrieval systems has been developed in parallel to its evolution, generating a great amount of proposals to achieve this process. This paper focuses on a particular task of Music Information Retrieval: a system for Cover Song Identification. We present a concrete example and then try to elucidate which metrics work best to evaluate such a system. We end up with two evaluation measures suitable for this problem: bpref and Normalized Lift Curves.
منابع مشابه
The analysis of hazard identification and risk assessment studies with the approach to assessing risk control measures since 2001 to 2017: A systemic review
Abstract background and aims: Nowadays the growing complexity of technology and industry has led to vast changes over the last few decades. These changes, in addition to their positive and valuable effects, have also caused industrial accidents affecting human life and the environment. According to the ILO 2011 report, there are 340 million annual workplace accidents and 160 million occupation...
متن کاملIdentification of parameters affecting the success of the hospital information system & presentation of a model for user satisfaction improvement
Complex institutions comprising several divisions and departments such as hospitals need access to information. Hospital information system has many capabilities and in case this system is acceptance by hospital staff, it leads to a revolution in the health care delivery industry. The identification of effective determinants and measures on the success of hospital information systems could sign...
متن کاملUnderground transportation system risk assessment to mitigate vulnerability against natural disasters through intelligent urban management
Quantitative and qualitative monitoring and evaluation of risk management programs will play an important role in the development of Tehran metropolitan railway transport. Considering the tectonic studies, seismic zones, land degradation and faults in north and south of Tehran, the development of underground railway lines, the assessment of the vulnerability of subway stations and the escalatio...
متن کاملImproving Binary Similarity and Local Alignment for Cover Song Detection
This is an extended abstract that overviews our cover song detection system as submitted to the MIREX 2008 audio cover song identification task. The system is developed starting from our 2007 submission but includes some important modifications and parameter tuning. Our system obtains the best results in all evaluation measures considered and its accuracy is proved to be statistically significa...
متن کاملIdentification of Teaching Strategies for Young Entrepreneurs: A Qualitative Study
With the aim of helping to improve the teaching of entrepreneurship in high schools, this study set out to identify appropriate teaching strategies. A selective group of 22 experts in the area of teaching entrepreneurship was extensively interviewed. The interviews were semi-structured and the data collected from them were coded using an open, axial, and selective coding system. Results show ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007